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from where to store his files, given a set of nodes which 
can execute his programs, to the major decision of 
whether to join the network at all. This model can be 
applied in the analysis of these problems. 
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Several algorithms — height-balance (i.e. AVL and 
extensions), weight-balance (i.e. BB and WB), and 
total restructuring— for building balanced binary search 
trees are compared. The criteria for comparison en- 
compass theoretical aspects (e.g. path lengths) and 
implementation independent and machine/algorithm- 
dependent measures (e.g. run time). A detailed analy- 
sis of code is also presented at a level believed to be 
language- and compiler-independent. The quality of 
the resulting trees and the overhead spent on building 
them are analyzed, and some guidelines are given for 
an efficient use of the methods. If insertion and subse- 
quent queries are the only operations of interest, then 
"pure" AVL trees present the overall best qualities. 
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1. Introduction 

Binary search trees represent an important tech- 
nique for handling structures such as files and directo- 
ries, dictionaries, and symbol tables. Nievergelt [8] 
gives a comprehensive survey of the methods used to 
create and modify binary search trees as well as some 
pertinent analytical results on the efficiency of these 
methods. Figure 1 provides a classification of these 
trees and references to previous works in this area. In 
this paper we restrict ourselves to the study of non- 
weighted binary search trees. 

The random growth of a binary search tree can lead 
in the worst case to a (linked) linear list. Hence several 
algorithms have been devised to balance or restructure 
the tree while it is being built, i.e. to keep it close to its 
optimal form. The three main methods for doing this — 
height-balance, weight-balance, and total restructur- 
ing—are introduced in the next section. We stress some 
aspects of the algorithms not covered previously in the 
literature. 

The main thrust of this paper is to compare these 
various methods. Path-length measures have already 
been used to assess the "goodness" of the resulting 
tree. We introduce some implementation-independent 
factors which affect the work generated to produce the 
trees. It will be seen in Section 3 that theoretical con- 
sideration as well as results of simulation experiments 
are sufficient to justify balancing techniques but not 
discriminating enough to make a judgment between 
them. 

In the next section, we try to be more precise about 
the concept of work. Naturally we have to relinquish 
some of the independence from the implementation. 
However, by looking at some timing experiments as 
well as at the monitoring of primitive operations, we 
feel that we can draw some conclusions about the 
respective values of the algorithms. 

In particular, we show that a height-balance tech- 
nique, the AVL tree construction, is the most efficient 
when the operations on trees are limited to insertion 



Fig, 1. Techniques to handle binary search trees. 




OPTIMAL NEAR-OPTIMAL 

(Completely <[6],(9l> 
balanced) 

323 



and queries. Furthermore we demonstrate that the idea 
of compromising between obtaining random and bal- 
anced binary search trees by relaxing balancing criteria 
Is not justified, since the loss in average path length is 
not compensated by the decrease in the number of 
balancing operations. 



2. Balancing Methods 
Definitions 

A binary tree is a finite set of nodes either empty, in 
which case we call it a nil node or a nil tree, or the triple 
T (T Lt r t T R ) t where r is a special node called the mot, 
and T L and T R are, respectively, the left and right 
subtrees of r. Each node s, except a nil node, is the 
father of its left and right sons (the roots of T\ and 7^) . 
A node with two nil-node sons is a leaf. 

In this paper (as well as in the computer representa- 
tions of the algorithms to follow), each non-nil node 
has four fields: LEFTLINK and RIGHTLINK, which 
are pointers to its left and right sons, a BALANCE 
field depending on the algorithm, and a DATA field. In 
binary search trees, the DATA field is some alphanu- 
meric information, or key, such that, for any non-nil 
nodes E7\ 

V^erz, key (s t ) < key (s), 
Vs,er R) key(s } )>key(s). 

Notice that we forbid equal keys. A nil node is pointed 
to by a NIL pointer from its father, and its fields are 
meaningless. 

The level of a node is 1 if the node is the root; 
otherwise it is the level of its father plus 1 . The level of 
a tree is the maximum of the levels of its non-nil nodes 
(i.e. the maximum level of its leaves). The height of a 
node is 0 for a nil node and the maximum of the heights 
of its sons plus 1 otherwise. The height of the tree is the 
height of its root (as well as its maximum level). Note 
also that a leaf has height 1 . 

The path length of a tree is the sum of the levels of 
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its nodes, or equivalently the sum over all nodes of the 
number of nodes in the path from the root to the node. 
The average path length is the path length divided by 
the number of nodes. 

A binary search tree is completely balanced if all 
levels (except possibly. the highest) are full. Such a tree 
is optimal with respect to minimal path length. A binary 
search tree is balanced if it is built according to the 
height and weight balance algorithms described below. 
A balancing algorithm will be top-down if it restruc- 
tures the tree during the insertion of a new leaf and 
bottom-up (although maybe only partially) if it has to 
retrace the path of insertion. 

Mechanics of Balancing 

The construction of a random binary search tree, 
i.e. one without balancing, is trivial. The key of the 
insertion node, which is necessarily a leaf, is matched 
with the key of the root. If it is smaller the process is 
repeated recursively with the left subtree, and if it is 
larger with the right subtree until a nil node is encoun- 
tered. This is the place of insertion for the new leaf 
(LEFTLINK and RIGHTLINK are set to NIL, DATA 
to key) for which the immediately previous non-nil 
node encountered is the father. The obvious link con- 
nection from the father is performed, and this implies 
keeping track of the father of the inserted node and the 
direction of the path of insertion (labeled F and FGO in 
figures and algorithms). 

Balancing is performed through transformations 
called single or double rotations. They are activated by 
the balancing algorithms under criteria which vary with 
each method. However, the resulting tree structures 
are the same and are sketched in Figure 2 (symmetric 
rotations naturally do exist) with their respective link 
changes (three for a single, five for a double rotation). 

Height-Balance Algorithms 

AVL trees [1,5] (named after their inventors, the 
two Russian mathematicians Aderson-Verskiy and 
Landis) and their extensions [4] are built according to a 
height-balance algorithm. A binary search tree is AVL 
if the heights of the left son and of the right son of any 
node in the tree do not differ by more than 1. The 
BALANCE field can indicate this with two bits ( + 1: 
higher right son; 0: equal heights; - 1: higher left son). 
The bottom-up algorithm for constructing an AVL tree 
consists of three phases: 

1. Find the place of insertion and the critical node. 

2. Modify the BALANCE fields between the critical 
node (excluded) and the new leaf. 

3. Balance at the critical node if necessary; otherwise 
modify its balance field. 

The critical node found in phase 1 is the last node 
on the path of insertion of BALANCE nonzero, or the 
root if no such node exists. Hence phase 1 is similar to 
the construction of a random binary search tree with 
this added critical node checking. Phase 2 implies a 
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Fig. 2. Rotations. 
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bottom-up algorithm. The BALANCE modification is 
immediate and depends on the direction of the path of 
insertion. In phase 3, balancing occurs if the subtree 
whose root is the critical node becomes more imbal- 
anced, i.e. if the direction of the path of insertion and 
the present BALANCE coincide. In this case, calling 
the critical node S with reference to Figure 2 , if 5 and 
its son GS have keys both larger (or smaller) than the 
new leaf, i.e. if SGO = GSGO, then we have a single 
rotation; otherwise a double rotation occurs. If the 
subtree becomes less imbalanced, a modification of the 
BALANCE field of the critical node is sufficient. Fi- 
nally, if the root was the critical node with balance 0, its 
balance field has to be modified. 

Foster has extended AVL trees [4] by allowing a 
difference in height of 5 (8 > 1). The algorithm is as 
above, but now, for reasons of efficiency, the search for 
the critical node is best handled by phase 2. The ration- 
ale is that in the AVL case all of the information 
necessary is in the visited node, but now the heights of 
both sons have to be checked. Since one of them is not 
on the insertion path, one wants to minimize the ac- 
cessing of nodes which are not of interest. Foster's idea 
was to trade-off increased path length versus a dimin- 
ishing number of rotations. As we see later, this is not 
necessarily a good idea. 

Weight-Balance Algorithms 

In these algorithms the criteria for balancing are 
based on the cardinalities of the subtrees (denoted (7^1 
for a tree of root s). 

A bounded-balance tree of balance a, BB(a) tree 
[7], has, for each node 5, 
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a < p, = (|rt| + \)/(\T>\ + 1) < 1 - a, 0 * a <; J. 

A top-down algorithm for 0 =£ a :£ 1 - £^5 is described 
in the above reference and follows the general line of 
the WB tree construction given below. The criterion for 
balancing involves the computation of the ratio p at 
each node on the path, and a rotation is performed 
(dictated by the weight of the subtree and the direction 
of path of insertion) if p is out of limits. Special care is 
needed for a > k and |P| = 2, i.e. a "small" tree, and 
the rotations applied in this case will be called leaf 
rotations (two or three link changes). This "small" tree 
concept can be generalized for any at, saving some 
checking [9]. 

WB trees [2], or weight-balanced trees, have been 
introduced mainly to be applied to weighted trees. 
However, the algorithm is still correct when all weights 
are 1. WB trees are defined dynamically through either 
a top-down or a bottom-up algorithm. Here we con- 
sider only the former. As in BB(a) trees, the BAL- 
ANCE field of a node s is |7*|. The criterion for rota- 
tion is to minimize the path length at the father of S [F 
in Figure 2). In general terms, a single rotation would 
be called (cf . Figure 2(a)) if 

weight (GS) + 17™'! > weight (S) + \7% P \ 

(where OP is the opposite direction of SCO) and a 
double rotation (cf . Figure 2(b)) if 

2 weight (GGS) + \Tl GS \ + \T% GS \ 

> weight {$) + \T S 0P \ . 
However, with equal weights of 1 , both criteria become 

it™i > \n P \ 

since 1 +■ \Ti GS \ + |rg cs | = {T 00 ^ 

As for AVL trees, single and double rotations are 
chosen according to the keys of S and its son on the 
path of insertion. Similarly a difference of-y (7 > 0) can 
be introduced as a parameter in the balancing criterion 
for the same expected trade-off as before. 

The top-down construction of a WB tree proceeds 
essentially like that of a random binary search tree. In 
addition, the following actions are taken during the 
visit of each node on the insertion path (except for the 
first two nodes which are handled differently since 
there can be no rotation until three nodes have been 
visited): 

— A test for balance is performed. 

— If the balance criterion is met, a (single or double) 
rotation is applied. This involves links and BAL- 
ANCE field modifications. 

— The BALANCE field of the visited node is modified 
(i.e. incremented by 1 if there was no rotation) and 
bookkeeping operations are performed to keep track 
of the nodes and associated directions needed for the 
next test for balance. 
A detailed Pascal implementation of this algorithm 

and of all those presented in this paper can be found 

in [9]. 



Total Restructuring 

While the term balancing is not justified for this 
method, the total restructuring of a binary search tree 
into an optimal one at some intervals to be determined 
is certainly worth investigating [6]. Several criteria to 
call for a restructuring come immediately to mind, and 
at least two of them are quite appealing [9]. 

(1) Keep track of the actual and optimal path 
lengths, A{T) and 0{T). After each insertion check if 
A(T) >: (1 + 6) 0(T) (0 s= 0 < 1), and if so restructure. 

(2) Assume a restructuring has just taken place. 
Let k = pog 2 (rjl 1 be the height of the tree. When t/»2 fc - 1 
(0 ^ <f> < 1) paths of insertion longer than (/3 + k) (p is 
an integer greater than or equal to 1) are encountered, 
a restructuring is performed. The rationale here is that 
the kth level is generally not full and that 2* _1 nodes are 
needed to fill it. If the tree is degrading rapidly, restruc- 
turing will take place to fill that level. 

In the series of experiments described below, we 
found that with fi — 1 and various values of 0, criterion 
(2) was in general superior to criterion (1). In the 
following we refer to the algorithm with criterion (2), f$ 
= 1 , a starting value of k = 4 for the testing in order to 
prevent restructuring of very small trees, and a value of 
0 =0.05 as algorithm COM. Later on, tf> will be 
varied. 

As pointed out by Martin and Ness [6], the restruc- 
turing can be done in place in 0(h) time (where n = 
\T\). 

Experimental Data 

As mentioned earlier, we performed a series of 
experiments to try to rank the methods. Two types of 
simulation runs were performed: 

(1) Experiment R, which involved trees built from 
10 sets of a 1000 randomly chosen keys. (We also took 
intermediary measures at 500 and 750 nodes.) 

(2) Experiment W, which involved trees built from 
the alternating set of keys (1, 1000, 2, ...). The letter 

, W is to draw attention to the fact that it is a worst case 
for the random and COM constructions and a "bad" 
case for the work involved in building the other trees. 
The alternating set was chosen instead of the ordered 
set because it produces single and double rotations 
instead of only single rotations in the balancing 
algorithms. 

3. Implementation-Independent Measurements 
and Comparisons 

While comparing the methods to construct binary 
search trees, we have to take into account two factors: 
the "goodness" of the resulting tree, i.e. its closeness to 
the optimal binary search tree, and how much work was 

1 TjcI is the smallest integer greater than or equal tour. [x\ is the 
largest integer smaller than or equal to x . In this paper all logarithms 
are base 2. 
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involved in order to obtain the binary search tree. The 
first measure is related to subsequent searching in the 
tree, while the second is an approximation of the over- 
head incurred in building the tree. 

The common metric for a searching mechanism is 
the number of comparisons used to find a match (or no 
match) for a given key. Translated into a tree structure, 
it implies path length measures. The worst-case mea- 
sure is the maximum level that a tree can achieve. For 
the algorithms of Section 2 and a tree of n nodes, we 
have 



Table I. Implementation-Independent Measures, n = 1000, flog n] 
= 10, optimal (average) path length 8.98. 



optimal tree 
random tree 
AVL 

BB(l-i72) 
WB-tree 

COM (<t>) 



flog n | 
n 

1.44 log(n + 2)-0.328 
(Fibonacci tree) 
2 (log(n + l)-i) 
2.32 (log(n + l)-l) 
(BBft)) 

flognl + l-t-<J>2 (K * 



=> 0(log/i) 
=> 0(n) 
=> O(logn) 

^ 0(log«) 
O(logn) 

=> 0(n) 



All these results but the last one can be found in the 
references already cited. The worst tree constructed by 
the COM method is obtained when, after a restructur- 
ing, (1 + (f>2 k ~ l ) nodes are inserted on the same path. 
However, one should remark that these long "tails" 
disappear periodically when the tree grows. Table I 
(column 1) shows the maximum levels obtained in 
experiments R and W. The maximum level for COM 
(0.05) is, according to the above formula, 

[log 1000] + 1 + 0.05 x 2 ,,OGlooa1 - 1 « 37. 

Interestingly enough this is the same figure as for n = 
750, and in the experiment W (a real worst case for 
COM) the maximum atn = 750 was 32, larger than the 
30 obtained at n - 1000. Somewhere in between the 
maximum level had reached 37 (in fact several times). 

Also of interest is the average path length. Since a 
random search tree has an average path length of 1 .39 
log (n + 1) [5], all binary search trees constructed by 
the above methods will have average path lengths of 
0(log n). No analytical results more precise than this 
order of magnitude have yet been obtained. By looking 
at Table 1 (column 2), we can see that all methods yield 
similar results for experiment R. Notice that although 
COM (cf>) produces long tails in experiment W t there is 
no degradation in the average path length. 

The value of the balancing algorithms is evident 
from these first two results. The (theoretically ex- 
pected) savings of close to 40 percent in average path 
length are present. More important, worst cases of 
linear path length are either avoided or intermittent (in 
the case of COM). 

Work Measures 

We now turn our attention to measures of the work 
needed to build the tree, but only from an implementa- 
tion-independent viewpoint. The first factor of interest 
is the (average) insertion path, i.e. the amount of 
searching done before inserting a new node. Since later 
balancings might modify this path, and in all cases 
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Table II. Path Length versus Rotation Trade-Off. 
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shorten it, the insertion path is longer than the path 
length (it is the same for random trees). Table I (col- 
umn 3) shows again that, with the exception of COM, 
all methods behave similarly. In experiment W we see 
that COM has an average insertion path almost double 
that of the others; this can be explained easily by the 
formation of the long "tails'* mentioned earlier. 

The insertion path was introduced because it is one 
of the adequate measures of the work involved for 
example in the detection of the next node to visit and 
the check for balance as described in Section 2 . 

We can associate also with the check for balance 
procedure a measure of the locality of the algorithm, 
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i.e. the number of nodes visited during an insertion. 
For the random and AVL constructions this number is 
similar to the insertion path (although for the AVL 
extension this is not true anymore, as seen in Section 
4). For the weight balance algorithms, nodes which are 
not on the insertion path are needed. In the BB case, 
the p computation calls always for the left son; hence, 
assuming that the insertion path is as likely to proceed 
in either direction, one has to access a node not on the 
path on every other check. In the WB tree the BAL- 
ANCE of the son of S which is not on the insertion path 
is needed at every check. Therefore it would appear 
that if AVL's locality is normalized to 1, BB's locality 
will be approximately 1.5 and WB's will be 2. But in 
the weight balance algorithms we have the relation 

BALANCE (left son) + BALANCE (right son) + 1 

= BALANCE (node). 

Hence if we were trying to restrict the number of visited 
nodes, as e.g. in a virtual memory or cache environ- 
ment, the nodes on the insertion path would be suffi- 
cient. 

The locality of the COM algorithm is very much 
linked to the number of restructurings m . In fact it can 
be computed as L = insertion path 4- i |T<|, where 
T t is the tree at the tth restructuring. In experiment R, 
L was about 13n (i.e. 1.4 times the insertion path and 
consequently approximately 1.4 times the locality of 
the AVL construction), and in experiment W f L was 
40n. This latter figure can be obtained analytically 
since, as we show below, we can obtain the number of 
restructurings in that case. 

The number of rotations certainly appears to be an 
influential factor. Very few analytical results can be 
derived on the number of rotations per insertion. Note 
that there is at most one rotation per insertion in the 
AVL algorithm, while possibly more than one will 
occur in the weight-balance constructions. Table I (col- 
umn 4) summarizes the experimental results. The BB 
algorithm seems slightly superior in experiment R, and 
experiment W certainly justifies its name for this mea- 
sure . 

For the COM algorithm, it is possible to derive the 
number of restructurings needed in the worst case. 
Assume that we have just performed a restructuring. 
The earliest time the next one is going to occur is after 
the insertion of \<f) 2 fc_l ] + 2 nodes. (Recall the worst 
case for the maximum level.) So in order to fill level k 
of the tree* we need 2 k ~ l /(\<f) 2 k ~ } ] + 2) restructurings. 
For example, starting the algorithm (experiment W) 
with fc 0 = 4, 2* 0_I = 8, there is no restructuring until six 
nodes have been entered. In fact when the first 15 
nodes are entered, we will have m 0 = 3 restructuring. 
Therefore the total number of restructurings m is 

LlUK nl 

_ V u n - v 

fcti [0 ui + 2 r* vl + 2 

where u = 2 k ~ l and v = 2 ,1< * n, ~ l , and in our case 



= 3 + (5 + 8 + • • • + 17 + 17) = 74. 

Again we can see that COM is quite sensitive to the 
worst case. 

Trading Off Increased Path Length 
for Decreased Work 

As was said in Section 2 we can relax the balancing 
criterions. Table II shows the same figures as Table I 
with different values of the parameters. For small 
changes of the parameter (e.g. 8 and y by 1 , a and <j> by 
0.05), we see an increase in path length of less than 3 
percent while the number of rotations is approximately 
reduced by half (in experiment R). In experiment W> 
however, path length and number of rotations remain 
the same, but the insertion path is increased by 10 
percent or more. Hence for that latter case allowing 
more imbalance is detrimental. But for the former, it 
appears that less work is required to build a tree of 
almost equal quality. Jumping at this conclusion is 
erroneous, as will be demonstrated in the next section. 



4. Comparison of Methods 

From the preceding section it is apparent that the 
balancing methods yield trees of equal quality. If one 
looks only at measures like the insertion path and the 
number of rotations, again there is not much differ- 
ence. In order to be more discriminating, we are 
obliged to delve more deeply into the details of the 
algorithms. Our goal is to answer the questions: 

— What is the "best" balancing algorithm? 

— Assuming that most trees are random, what is the 
ratio of the number of insertions to the number of 
subsequent queries which makes a balancing worth- 
while? 

— What is the value of varying the parameters of bal- 
ancing criteria? 

The analysis that we present now should by no. 
means be considered as an absolute judgment on the 
"complexity" of the algorithms. It is simply an attempt 
at ranking the algorithms based on some experimental 
evidence and a (nonrigorous) analysis of code. We feel 
that the code is of the same efficiency for all methods. 
The analysis is as much as possible machine and lan- 
guage independent, but some implementation consid- 
erations may enter the discussion. 

We start by analyzing the random algorithm. Let / 
be the average insertion path. Our unit of "time" will 
be a "move" along the path which corresponds to a key 
comparison, two pointer settings (father and son), and 
a direction setting. The number M R of moves of that 
type in the construction of a random binary search tree 
of n nodes is M R — n (/ - 1), with / in this case being 
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also the average path length. 

The only other "work" performed by the algorithm 
is the insertion of new nodes, which implies getting a 
new node from a list of available space (or increment- 
ing an index), setting the data field and pointer links, 
and linking the new leaf to its father. This is of the same 
order of magnitude as a move. Hence the cost of the 
algorithm is C R — n I. 

Although some other work will be done in conjunc- 
tion with this part of the algorithms, the code corre- 
sponding to the search of the place of insertion in a 
random tree appears in all algorithms. In all tree- 
searching algorithms, the number of moves to find the 
place of insertion is M = n (I - 1). This value for M is 
slightly too small because it does not take into account 
the overhead due to the modularity of the program 
(procedure calls). As before we also add the insertion 
time, i.e. AT = n (J - 1) + n = n /. We consider now 
the added work needed in each algorithm. 

AVL Analysis 

Phase 1 of the AVL construction does the searching 
and insertion (cost M A ) and the detection of the critical 
node. To obtain the latter, we need one comparison per 
node on the insertion path, except for the root and the 
leaf, and if the balance is not zero one more compari- 
son and four pointer settings. The latter should occur 
approximately 35 percent of the time (cf. [4, 5] for 
analysis and justification). Since we have one compari- 
son per node and a little less than a move i of the time, 
we can approximate the cost of phase 1 by: 

P K = M A + 0.5n (f - 2), 
P { = n (1.5 / - 1). 

In phase 2, the balance fields between the critical 
node (excluded) and the leaf (excluded) must be 
changed. The same analysis as before [4, 5] shows that 
on the average there are a little less than 2 nodes (1.8 
to be exact) between the critical node and the leaf. The 
balance field change itself has a cost slightly higher than 
that of a move. Therefore P 2 = 1.8 x 1.25n = 2.25n. 

Finally, in phase 3 either a balance change occurs at 
the critical node or we perform a rotation. Quoting 
again [4, 5] (cf. also Table I), we see that we have a 
balance change a little over half of the time. A single 
rotation (three link settings and two balance fields 
settings) is approximately one move, while a double 
rotation (five link settings and one comparison plus two 
balance settings) corresponds to two moves. Hence 

P z = 0.5 x L25/i + 0.25* (1 + 2) = 1.37/1, 

and 

C A = P l + P 2 + P 3 , 

C A = n (1.5 / + 2.62). , (1) 

To justify this analysis, we consider the results of ex- 
periment R. We saw (Table I) that the AVL average 
insertion path was 9.7, yielding C A = 17.17/1. Setting a 



Table III. CPU Times. 







Experiment R 


Eiperimenl W 


RAN 




0.58 


>10 


AVL 




0.96 


1 .06 


Extended AVL 


6 *■ 1 


1.49 


1.83 




A « 2 


1.35 


2.13 




8-5 


1.64 


2.75 


WD 


> -0 . 


1.71 


1.92 




y - l 


1.72 


2.11 




y -* 


1.74 


2.64 


BB 


a-l -\Jl 


2.20 


2.84 




a - 0.25 


2.36 


3.68 




a - 0.15 


2.J2 


5.34 


COM 


4 - 0.05 


0.93 


3.M 




4 ~ 0.10 


0.77 


2.58 




4 - 0.25 


0.71 U 


2.90 



normalized C R to 1 (instead of 12.14«), we have C A 
^17.05/12.14 =1.41. 

In order to test our assumptions, we timed the 
algorithms (cf. Table III) on a cdc 6400, discounting 
the overhead of reading in the keys. For experiment R 
the average oiT A /T R was T A /T R = .96/.S8 = 1.65. This 
is certainly in accordance with our analysis. The fact 
that our prediction is quite accurate should not be 
overemphasized. The order of magnitude is the impor- 
tant fact. 

VVB Analysis 

The search and insertion times are as in the AVL 
construction, i.e. M' w = nl. The test for balance costs 
approximately 1.5 moves (four settings, two compari- 
sons) and has to be done on the whole insertion path 
except for the first two nodes. Hence B w = 1.5 n {I - 
2). 

The bookkeeping implied in either the rotation pro- 
cedures or the check for balance corresponds to an 
increment in the balance field and five pointer settings, 
again a little more than a unit move. It has to be done 
on all nodes but the first two (handled differently) and 
the leaf. Therefore G w = 125 (/ - 3). The rotations are 
slightly more expensive than in the AVL tree because 
of the changes in the balance fields. A single rotation is 
about two moves and a double rotation about four. 
Hence the rotation work is R w - 0.25 (2 + 4)n ~ 1 .5 • n , 
and finally 

C w = n(3.75 / - 5.25). (2) 

Testing as above, C w =31.12/12.14 = 2.56, and the 
timing experiment yielded T W /T R = 1.75/. 58 = 3.02. 

A possible reason for our conservative estimate is 
that in the check for balance we called a function for 
finding an opposite direction, while in the analysis we 
counted it as an online segment of code. 

BB-Analysis 

The BB algorithm for a = 1 - follows the same 
line as the WB one. However, there is one major 
difference: the check for balance includes a division, 
two comparisons, and two additions in opposition to a 
comparison and a subtraction in the WB case. The 
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amount of time spent in a division being very much 
machine dependent, we can only assert that the BB 
algorithm will take longer than the WB. Our timing 
experiments yielded T B /T R = 2.20/. 58 = 3.79. Since 
the cdc 6400 performs division rapidly, timing on 
slower machines might show degradation of this ratio. 

COM-Analysis 

In the COM algorithm, a move is the same as in the 
random construction. Hence M' c = nl. The check for 
balance consists of one incrementation per node on the 
path and two comparisons per insertion, i.e. overall a 
fraction of the cost M c . Most of the overhead of the 
COM algorithm is then spent in the restructuring. Since 
the traversal of the trees to be restructured is very much 
implementation-dependent, there is no hope of analyz- 
ing its cost as with the other methods. Just as an idea of 
what can be obtained; our timing experiments yielded 
TJT R = .93/. 58 — 1.62. But because in the worst case 
T e is multiplied by a factor of 4, compared to 1 .1 or 1 .2 
for the balancing algorithms, this method is not a com- 
petitive one. 

A First Conclusion 

From the above analysis it appears that AVL is the 
best algorithm. If one assumes that worst-case trees, or 
trees close to them, can arise, then all balancing algo- 
rithms (but maybe COM) are of interest. On the other 
hand, if it is certain that only random trees may occur, 
one should know at which point the overhead due to 
balancing is overcome by the quality of the resulting 
tree. Considering first the AVL tree, if q queries are 
performed after the original insertion, then the (aver- 
age) cost will be 

Qr - (q + 1)C R , for the random tree 

and 

Qa = C A + ql = C A + 0.8? Q*. for the AVL tree 

if the ratio of average path lengths is independent of the 
size of the tree. As soon as? is such that {0.2q + 1)C R > 
C At the AVL tree construction becomes beneficial. Our 
analysis tends to show that q must be at least 3. 

A similar reasoning yields a value for q of 8 for the 
WB tree and certainly over 10 for the BB tree. Note 
again that these figures are independent of the size of 
the tree (formulas (1) and (2)). Before answering the 
question of the significance of the weight-balance algo- 
rithms, since the height balance ones behaves better, 
we look at the effect of the variations of the balancing 
parameters. 

Extended AVL Tree 

In the extended AVL, the contents of the balance 
field is the height of the node. The algorithm for ex- 
tended AVL is slightly different from the "pure" one 
since the critical node search is now done in a bottom- 
up phase. The top-down phase 1 stacks the path of 



insertion. This extra bookkeeping of pointers and di- 
rections (three assignments and one increment) costs a 
little less than a move. Hence P[ = 1.75n(/ - 1) + n. In 
phase 2 we go back up the tree, checking for the critical 
node and changing the balance fields. The critical node 
detection implies the difference of heights between the 
two sons of a given node (notice now a degradation in 
the locality of the algorithm which is not correctable as 
in the weight-balance methods). Taking the case 8=1 
(i.e. comparing with the "pure" AVL), we have 2.8 
checks for a critical node which involves initialization, 
moving up the stack (.5 move), finding the heights of 
both sons and updating the height of one node (1 
move), and checking for a critical node and a possible 
rotation (1 move). If the node is not critical, we go back 
up the stack (1.75 move). 

Pi = (2.8(0.5 + 1 + 1) + 1.8 x 1.75)n = 10.15n. . 

Finally, the rotations are slightly more time con- 
suming because of the height changes; hence P' 2 = 
0.25(2 . + 3)n = 1.25n, and the cost of the height- 
balance algorithm is 

C H = n(1.75/ + 10.65). (3) 

For experiment R this becomes C H = 27.62/12.14 = 
2.27, and the timing experiments yielded T H /T R ~ 
1.50/. 58 — 2.58, again close enough for our purposes. 

Comparing formula (3) and formula (1) shows that 
in all cases the pure AVL method is better, since in 
formula (3) the insertion path has a larger coefficient. 

Returning now to formula (3), we see that the 
rotation cost P' z is only \.2Sn. Increasing 8 decreases 
this number, but will also increase the path length and 
the length of the bottom-up pass. For example, with 5 
= 2 we found out that 2 (with the obvious notation): 

P[(2) = Pi(l) + 1.75 x 0.015«/ ~ P[(l) + 0.26/z, 

P' 2 (2) = Pi(l) + (3 - 2.8) x (2.5 + 1.75)n 

« Pl(l) + 0.85/J, 

Pi(2) = ^(l)/2.25 - Pi(l) - 0.70*. 

Hence the increase due to the imbalance is about .4 In 
in unnormaiized fashion or 0.04 in normalized fashion. 
The increase in time was very small, as expected (0.06 
instead of the expected 0.02). And repeating the same 
analysis with 6 = 5 yielded .12 expected time increase 
for .15 real increase. 

Independently of the accuracy of the prediction, 
we can see that the savings in rotation time is always a 
small percentage of the total running time. Therefore 
keeping 8 = 1 is preferable. 

Weight-Balance Extensions 

We can perform the same type of analysis for the 
WB and BB algorithms. According to the derivation of 

1 We arc indebted to C.C. Foster for pointing out that the critical 
node, when 6 * 1 , is the node furthest from the root at which either a 
rotation is needed or where the height of the son on the path of 
insertion is not greater than the height of the other son. 
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formula (2), a decrease in rotation would save very 
little. For example, letting y - 1 saves 0.75n in R w (cf. 
Table III) and adds 3.75(7' - /), where /' is the new 
insertion path (cf. formula (2)), i.e. in our experiment 
3.75 x 0.09/1 = .34«. Hence a total savings of about 
.4/2, or in CPU time an expected 0.02. In fact measure- 
ments showed an increase of 0.01 in time, again a very 
accurate prediction. For the BB construction, the in- 
crease due to a longer path insertion will be larger 
because of more divisions, but on the other hand short 
cuts can be taken in the number of checks when the 
subtree on the path of insertion becomes * 'small" [7]. 
Our measurements showed that for a = .25 and a = 
.15 there was very little difference in CPU time for 
experiment R y but a substantial time increase was ap- 
parent in experiment W. 

The CPU times for a variation of <f> showed a slight 
decrease for COM times as <f> became larger. This is in 
accordance with the fact that the work on the path of 
insertion counts for less than in the other methods and 
that restructurings are costly. Making 0 large, how- 
ever, would be extremely dangerous if a tree close to 
the worst case were to happen (cf. Table II, <j> - 0.25). 

We are now ready to summarize the results from 
Sections 3 and 4 and make some judgment about the 
respective qualities of the methods. 

5. Summary and Conclusion 

Quality of Trees Tor Searching 

This is a path length measure. As shown in Section 
3, all four methods yield an average path length very 
close to the optimal one. Because of possible long 
paths, the total restructuring method is less reliable. 

Work Involved in Building a Tree 

The AVL construction presents less overhead. For 
all trees the elegant method presented in Section 2 
should be followed. If the number of subsequent quer- 
ies is larger than three per node, then AVL trees should 
be recommended over random trees. Similarily WB 
trees can be used if there are at least 8 queries per 
insertion, and for BB trees this ratio is at least 10 with a 
machine performing fast divisions. 

If, besides insertions and queries, one wants to 
perform splitting and concatenation of AVL trees, then 
the balance field must contain the height of a node [5]. 
If furthermore one wants to use the tree as a ranked 
list, a field similar to the one used in BB and WB trees 
is necessary. Therefore weight-balance algorithms 
might be more competitive for some applications and 
should not be discarded entirely. This is even more true 
of WB algorithms, which can also be used efficiently for 
weighted trees (2]. 

Relaxing the Balancing Criterion 

Relaxing the balancing criterion gives a slightly 
worse tree for subsequent searchings and, most impor- 



tant, does not save any work. For the AVL tree, there 
is a non-negligible loss in time and locality. For WB, 
extended AVL, and BB trees, the cost of building trees 
is stationary for random trees but increases substan- 
tially for degenerate trees. 

Therefore we can present two important conclu- 
sions: 

— Balancing methods are worthwhile even if the nodes 
in resulting trees are going to be queried only a few 
times each (on the average). 

— The best balancing methods are the "purest," i.e. 
those involving the strictest balancing criteria. This is 
true of the quality of the resulting tree and the cost of 
building it. 

Finally, we might suggest that some comparisons of 
that type could be done for other data structures such 
as the implementation of priority queues by heaps or 
leftist trees. 

Received September 1975, revised March 1976 
References 

1. AdePson-Velskiy, G.M.,and Landis, Y.M. An algorithm for the 
organization of information. Doklady Alcad. Nauk, SSSR (Moscow) 
76, 2 (1962), 263-266. Translation, OTS, JPRS, 17, 137, Dept. of 
Commerce, Washington, D.C. 

2. Bacr, J.-L. Weight-balanced trees. Proc. AFIPS 1975 NCC, 
Vol. 44, AFIPS Press, Montvale, N.J., pp. 467-472. 

3. Domesle, R. On the construction of weighted binary search 
trees. Masters Th., U. of Washington, Seattle, Wash., June 1975. 

4. Foster, C.C. A generalization of AVL trees. Comm. ACM 76,8 
(Aug. 1973), 512-517. 

5 . Knuth , D . The A rt of Computer Programming , Vol. 3 : Sorting 
and Searching. Addison- Wesley, Reading, Mass., 1973. 

6. Martin, W. A., and Ness, D.N. Optimizing binary trees grown 
with a sorting algorithm. Comm. ACM 75, 2 (Feb. 1972), 88-93. 

7. Nievergelt, J., and Reingold, E.M. Binary search trees of 
bounded balance. S1A M J. Computing 2, 1 (March 1973), 33-43. 

8. Nievergelt, J. Binary search trees and file organization. 
Computing Surveys 6, 3 (Sept. 1974), 195-207. 

9. Schwab, B. Comparison of balancing algorithms for binary 
search trees. Masters Th.,U. of Washington, Seattle, Wash., June 
1975. 



330 



Communications 
of 

the ACM 



May 1977 
Volume 20 
Number 5 



